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ABSTRACT 


This thesis examines a two-person zero sum game where a submarine, after revealing 
his position by causing a ‘flaming datumy’ , is hunted by a helicopter which arrives on the 
scene after a time delay. Various helicopter and submarine strategies are explored and 
simulation runs are used to determine the detection probability (payoffs) for each com- 
bination of helicopter and submarine strategy. The value of the game (detection prob- 
ability) with the related optimal strategies is then obtained using linear programming. 
A modified random search equation 1s also derived using probabilities of detection ob- 
tained from different combinations of parameters used in the game. Similar and related 
games are also discussed with emphasis on the differences in assumptions made and ap- 


proaches taken in order to solve the problem. 
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IL. INTRODUCTION 


A. DESCRIPTION OF PROBLEM 

A submarine has just fired a torpedo at a ship, scoring a direct hit. This causes the 
ship to stop immediately and be in flames, hence the term, ‘flaming’ datum. The ship 
on being hit immediately sends out distress calls and a sonar carrying helicopter 
responds by proceeding towards the ‘flaming’ datum. It arrives on scene after a time 
delay and thereafter makes repeated active sonar dips within the expanding 
farthest-on-circle( FOC). The term FOC is a commonly used search term which describes 
all the possible positions within a circle (of area nU?r?), that a target can be, given a top 
Speed of E. There is also a time delay for each dip due to the time required for lowering 
and raising the sonar transponder. The submarine on detecting each and every ping 
emitted by the helicopter's sonar reacts so as to mininuze his probability of being 
detected within the helicopter's limited time on station. The game can only end in two 
ways; the submarine 1s found within the helicopter’s sonar range during one of its dips 
and hence is detected or the submarine is undetected during the hmuted nussion time of 
the helicopter. We consider an abstract version of this situation characterized by five 


parameters: 
e V - Speed of helicopter 
е U - Speed of submarine 
e D - Time delay in dipping sonar 
• т,- [ime for helicopter to reach edge of FOC 


e R- Radius of sonar detection svstem 


В. BACKGROUND 

Search theory in military applications has usually concentrated on the idea of 
attempting to find an object by moving a sensor sufficiently close to it. The object has 
a definite position in space and the distance between it and the sensor is crucial. Search 
theory has evolved from searching for stationarv targets, to moving targets and 
presentlv, to evasive targets. Stationary and moving target problems are normally 
classified as one sided problems because the target does not know or make use of the 


knowledge of where the searcher is. The present emphasis is on two-sided problems, 


which are more difficult to solve. These are problems where targets wish to avoid 
detection , and have the capability to do so. 

The theory of Games is naturally applicable here since this is the situation of a 
maximizing plaver (searcher) wishing to maximize a payoff (for example, the probability 
of detecting the target) and a minimizing plaver (evader) wishing to do the opposite. In 
such situations, optimal strategies of both players are sought after as well as the value 
of the game where we want to know how best one side can deny or allow the other side 
an expected minimum or maximum payoff. One classical two sided game formulated by 
Morse and Kimbal [Ref. 1] involves searching for a submarine that is transiting a 
channel of varving width that is too long to allow the submarine to remain submerged 
during the entire passage. In his book, ‘Geometric Games and their Applications’ 
(Ref. 2] Ruckle considers a class of two-sided geometric games. Gal considers two sided 
search games plaved on networks [Ref. 3]. A good reference for bibligographies can be 
found in Dobbie’s survey of Search Theorv [Ref. 4]. This 1s updated Бу Washburn's 
tutorial on search theory where he covers the development of search theory up to 1986 
[Ref. 5]. 

The author 15 interested in the submarine evasion game first considered by Danskin 
in Which a submarine, after revealing his position by causing a ‘flaming’ datum, is hunted 
bv a helicopter which arrives at the datum after a time delay [Ref. 6]. This is a special 
class of two sided search games where the target has the advantage of observing the 
searcher's action, but the searcher has the advantage of speed. This advantage will be 
slowly lost as search progresses since the various positions that the submarine can 
occupy will expand with time. Related games are the one-dimensional helicopter 
submarine games studied by Meinardi [Ref. 7] and more recently bx Baston and Bostock 

|Ке!. 8). Мешагф solves a discrete form of the game while Baston and Bostock solve 
the continuous case. Besides Danskin’s game, not much work has been done on the two 
dimensional case except the work by Thomas and Washburn [Ref. 9] in their paper on 


dynamic search games. 


C. APPROACHES 


Three solution approaches will be considered: 


l. Analytical 

In the next chapter , we will see solutions to related games. The one 
dimensional ‘flaming’ datum problem can be solved either by using the methods of 
Meinardi or Baston and Bostock. However, the one dimensional case is onlv a special 
case where the search area can be considered to be a long channel with respect to the 
sonar detection radius. Attempts to solve the two dimensional case have not been 
clearly successful since additional simplifying assumptions are needed. In Danskin's 
game, the assumptions made (he assumes passive search) are clearly to the advantage 
of the helicopter. However, in Thomas and Washburn's dipping sonar game, two major 
assumptions are made, one that favours the submarine (nimbleness assumption) and 


another that does not (remain motionless between dips). 


2. Data Analysis 

Another way to solve the ‘flaming’ datum problem is to collect and analyse real 
world data. Such data mav or mav not be obtained from past wars, conflicts. or even 
eldwexercises, However, such data аге few, expensive and difficult to obtain. A 
compromise is to conduct a two sided search experiment as was done bv Washburn in 
his Expanding Area Search Experiment. [Ref. 10] However, Washburn's experiment 
differs from our ‘flaming’ datum problem. The target is assumed to be ‘blind’ with no 
knowledge of the searcher’s position once the search commences while the searcher 1s 
assumed to be a ship or aeroplane continuously sweeping an area. In his experiment, 
different groups of NPS students are used as game players. This technique can perhaps 
be used as the next stage in our attempt to solve the ‘flaming’ datum problem. The only 
disadvantage is that the experiment will take a long time to complete since many 


different people are needed. 


3. Simulation Methodology 
Ihe approach taken here is to build multiple simulation models where Monte 
Carlo runs are used to determine the detection probability when a helicopter uses a 
certain Strategy against a certain submarine strategy . Two person zero sum solution 
methodology is then used to solve the resulting matrix game. This simple method allows 
one to estimate the outcome quickly and rather cheaply as compared to conducting 
numerous fleet exercises. It may also act as a starting point for more sophisticated 


models. A more detailed description will be given in the later chapters. 


Il. RELATED GAMES 


In this chapter, two one-dimensional and two two-dimensional games related to the 
‘flaming datum’ problem will be discussed. These are the games by Meinardi [Ref. 7], 
Baston and Bostock [Ref. 8], Danskin [Ref. 6] and Thomas and Washburn [Ref. 9] 
respectively. The ‘flaming’ datum problem can only be formulated as a one dimensional 
game (in space) if the search area under consideration involves a long channel such that 
the sonar detection sweep width is at least greater than the channel width. Meinardi 
(Ref. 7] has solved a discrete (in time) version of such a game while more recently, 
Baston and Bostock [Ref. 8] have solved the continuous version. In all the two 
dimensional cases treated so far, many assumptions have to be made in order to solve 
the game. This is evident in both Danskin’s and Thomas and Washburns’ games. 


General analytical techniques for the two-dimensional game are presently unavailable. 


A. ONE DIMENSIONAL GAMES 
l. A Sequentially Compounded Search Game 

Meinardi [Ref. 7] considers a multi-staged search game where the target 1s 
hiding in a row of n boxes labelled | то zy. At each stage , the searcher selects a box 
and examines it. The probability of finding the target when the correct box 1s searched 
is equal to qx 1.0. If the target is not found, the target may either move to a 
neighbouring box or remain in the same box, and the next stage is plaved. The target 
as well as the searcher keeps track of which boxes have been searched. The searcher is 
limited only in the number of boxes to be searched, so that the time taken to search a 


box or transit between boxes does not come into consideration. 





Figure l. Boxes for Meinardi's game 


Pwetne statu a! the Came, the target is in box |. (see Figure 1) corresponding 
C сопа ume delar mar occur before thie first search 1s made. The tarset 
ШЕ е DC ll ANC O! the first л, boxes when the first search is made. With each 
stage, the number of boxes which mav contain the target 1s augmented bv one (since the 
target 1s limited by jumping to neighbouring boxes onlv). Memardi [Ref. 7] shows that 
the optimal strategies of the searcher and the target are such that thev alwav attempt to 
distribute themselves as uniformly as possible over the number of boxes available. He 
also shows that if g exceeds a certain critical value g.,,,. the target will not be able to use 
such a strategy. In such a case, the target will attempt to distribute his positional 
probabilitv over whatever boxes that he can. 

Meinardi derived the critical q to be 


n+ ]—k 
Gent = о 


where K 1s the box that 1s searched when n boxes are available. If g<q,,,,, the target can 
equalize its probability of being in anv of the (7 + 1) boxes available in the next stage. 
Since the smallest value of g.,,, is with k =n, the smallest g,,, in the game (denoted q.,,,) 


Is given bv 


сл 


А ] 
dent Mg + $9— 2 ˆ 


А A 
except that дал = 1 for a one stage game. 


Here ny is the initial number of boxes available at the start of the game and s, is the 
number of stages available in the game. It is also useful for us here to reproduce some 
of his results. Case 1 shows the result for the case when the critical q value 1s not 


. ۰ . А 
exceeded while case 2 1s an example of a case when q 1s greater than q,, 


Case I: Two stage game, for a small q. 

Let Ig be the value of the game where s + l is the number of stages of the game 
remaining and z , the number of boxes available (similar notations are also used for the 
optimal strategies X and Y). 


The value of the game is given by 


i q q 0 s 0 ff N 
Га = С) +0) Га) жле Гр = ( TET ) (23) 
with optimal strategies 
sl 3 ] ] ] 
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where Xand Y represent the distributions of searcher and target positions. In other 
words, the searcher 1s equallv likely to search any boxes, and the target moves in such 
a manner that he 1s equally likelv to be in any box. In this case, go = = so the above 
] 

results are valid as long as qx m 

The case when g > g,,,, iS more complicated. We will onlv show the results for the case 
of a two stage game where n, — 2 (as solved by Meinardi). More detailed derivation can 
be found in [Ref. 7]. 


Case 2: Two stage game, q > T , N= 2, Q. = + 
7—24 - 

I7 C973, за 
with optimal strategies 
E Е Qn х 
А = r. с ! yT ] for the searcher (2.5) 

| 4 3—2 
B. = [ D кота F ] for the target (2.6) 


The above result shows that both the searcher and target do not equalize their 
probability of being in any of the boxes available. This happens because the target is 
unable to do so. To illustrate this, consider the case when g = l and where box 2 1s 
searched in the first stage of the game. Clearly, the target must be in box 1 in the first 
stage or else it will be detected. The target is thus unable to move to box 3 at the second 
stage since it is hmited to moving to neighbouring boxes onlv. The target can therefore 
Cs or (0.00% 2.07 remain in box l . If gis less than 1, then there will be some 
probability that the target will not be detected even if the correct box is selected. If the 
target 1s initially in box 2. then there would then be some probability of the target 
moving to box 3 in the second stage, but not as much as 1 Гард. · In general. the 


target should equalize, as well as it can, the probability of being in any box. 


2. A Helicopter-Submarine Game On The Real Line 
Baston and Bostock [Ref. 8] also consider a game very similar to the flaming 
datum problem. Their game can be considered to be a continuous version of Meinardi's 
game [Ref. 7] since it is again a one-dimensional problem where the submarine is 
assumed to be moving in a long narrow channel. 1n their game, there 1s one helicopter 
carrying j anti-submarine bombs. The helicopter ( max. velocity V) wishes to destroy 
the mobile submarine ( max. velocity U) using its bomb. Each bomb has the same 


destructive radius R and there is a time lag D between the release of the bomb and the 


bomb exploding. The number of bombs is analogous to the number of dips available 


and the bomb's destruction radius 1s analogous to the sonar radius. 





Figure 2. One dimensional helicopter-submarine on the real line . 


The notation used in their game 1s illustrated in Figure 2 . The helicopter and 
submarine are initially at A and B respectively, distance L apart. If the bomb explodes 
within distance R from the submarine then the pavoff to the helicopter is 1 unit: 
otherwise, he gets zero. Each plaver knows the iniual position of the other plaver but 
not their subsequent positions. Thev are restricted to move at their maximum speed and 
instantaneous changes in velocities are allowed. The value of the game, I is given 
below: 

/], When ыы 


number of bombs that the helicopter is carrving since onlv one bomb 1s needed. The 


<R the values I Z+ resardiessse me 


helicopter proceeds to point B at its maximum speed and drops his bomb there. The 
submarine could not travel a distance greater than R, given the time the helicopter takes 


L еме 
to get to point D, р plus the bomb activation time D. 


U(L + VD) 


(2) When V 


>R , the value of the game is given by 


Te for 1 <j < k and 


i [or] > k 


Where & 1s the unique integer greater or equal to 2 which satisfies 


UL + VD) UL VD) | 
nw FSS IT OF | (2.7) 


When (j > 2) bombs are available to the helicopter, an additional condition is required 


іп that the time delay must be small , that is, R > UD-—L The other case where 
К < UD- L is still being studied by Baston and Bastock. 
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Figure 3. Graphical representation of Baston and Bostock 
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A graphical representation of the game 1s shown in. Figure 3. The dashed lines show 
the possible positions of the submarine from B. The vertical short solid lines show where 
the bombs should be dropped. Note that a feasible submarine track must intersect at 
least one of those intervals. In the above example, k=3 and the value of the game is 


m ). Hence, 3, the value of the game is | and the submarine is always destroyed. 


B. TWO DIMENSIONAL GAMES 
l. Helicopter Versus Submarine Search Game 

Danskin [Ref. 6] considers the case where the submarine has only 1 set of 
strategies, 1.e,choose a fixed course 8 (0<0<360°) and speed U (OS U<U,,,,) and adhere 
to them throughout the duration of the game. He assumes that the submarine knows 
nothing useful about what the helicopter is doing and therefore sees no reason for any 
changes in course cr speed once selected. Danskin describes this strategy as the choice 
of a point in the submarine’s ‘speed circle’ of radius U,,,,{(See Figure 4). The submarine 
picks this point and stays at it throughout the game. With each dip, the helicopters 
sonar detection system will cover an area of zR- in real space or an equivalent area of 


mR , | | | | 
z m the speed circle at time ¢ (see Figure 4 overleaf). He assumes that the helicopter 





strategies are to dip at a succession of points in the speed circle such that the 


corresponding covered circles do not overlap each other. Hence if the dips are at times 





| ТІ ] | 
БО c the heliopter will cut a total area 49 — п“ + m J Otto! (lie 
| 5 5 


speed circle. This is shown in Figure 4 overleaf. 


ll 
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Figure 4. Dips and Speed Circle. 


In his game, Danskin proposes that the area , Ay be squeezed into a wedge of the saine 
area in the speed circle. He solves the game and shows the value to be 
I = — = = ‚This is the probability that the helicopter's wedge covers the point the 
submarine has picked in the speed circle given that the orientation of the wedge could 
be picked randomly. ; 

Based on Danskin’s assumptions, [Ref. 6] the helicopter has a better chance of 
detecting the submarine than in the flaming datum problem. The various cookie cutter 
sonar dips of the helicopter do not overlap each other. The submarine also does not 


employ any evasive maneuvers. 


2. Dynamic Search Games 

Thomas and Washburn [Ref. 9] have solved a very similar game which they 
termed ‘dipping sonar’ game. It contains all the elements of our flaming datum problein 
except that the rules of motion for the submarine are revised. In their game, the 
submarine 1s permitted to instantly choose anv new position after each unsuccessful dip 
bv the helicopter, as long as he stays within the Farthest - on - Circle (FOC), termed the 
“nimbleness” assumption. Another assumption made is that the submarine remains 
motionless 1n the speed circle between dips of the helicopter. All these assumptions are 
necessarv for them to solve the game using Dynamic Programming. Briefly , the game 


is solved using the following recursive equation 


О(ы) = min, max, {1 — ox PU. & T()) QU. TD ) (2.8) 
j k 
where 


е ОГ) value of the game , the probability that none of the remaining searches 
will detect the target if both sides play optimally. (i,t) represents the state of the 
pemesshere the submarine is in cell, 1, and time , t . 


e P(jk,.) — Probability that a target in cell k will be detected by a search of cell j 
begun at time t. 


e T(ij.)-7 Time at which a search of cell j can begin if a search of cell 1 begins at 
(ne t. 


The game proceeds in the following fashion: 


1. After observing (i.t) the target will choose a cell k to hide while the searcher will 
choose a new cell j to search without knowing k. 
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2. If Tajoer”, е тегиле ое ЕИО о sie 
Otherwise with probability PG, k, T(ij,k)) , the target 1s detected and searcher wins. 


4 


3. If the target is not detected semino and он рол Ку слепени es е 


The solution 1s obtamed recursively with the end state Ollerton, ока 
with y = (у) апа х = (ху) being probability distribution over the cells for the searcher and 
the target respectively. The various positions to be picked by the helicopter and the 
submarine are obtained by dividing the speed circle into 1 cells of equal area. Applving 
the game to our flaming datum problem, this dynamic search game tends to favour the 
submarine on account of the nimbleness assumption. This favourable condition for the 
submarine might be neutralised by an additional assumption that the submarine 1s 
assumed motionless between dips. Intuitively, it seems that the nimbleness assumption 


would more than outweigh the motionless assumption. 
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ПІ. MODELS, THEORY AND ASSUMPTIONS 
A. ASSUMPTIONS 


l. Submarine motion 
The submarine is assumed to be moving always at a fixed speed U, once it starts 


Its evasive maneuvers. Instantaneous changes in course are allowed. 


2. Helicopter motion 


The helicopter is also assumed to be moving at a constant speed V, during its 


search for the submarine. Acceleration and retardation are ignored. 


3. Sonar Characteristics 

The helicopter active sonar is assumed to illuminate a circular area of radius 
R, perfectly on each dip. Each dip can thus be considered to be a ‘cookie cutter’ where 
within such a radius, detection is certain and outside it, detection is impossible. Each 
sonar dip is assumed to take a constant time delay of D time units. This is attributed 
to time taken for the sonar device to be winched in and out of the water and time for the 
signal processing unit of the sonar to check for detection. 

The submarine is assumed to know the latest position of the helicopter 
Whenever it pings. However, this assumption was later relaxed to one in which only 
bearing information is known as we later found out that among the strategies explored, 
Strategies that made use of this position information were dominated by those strategies 


which only make use of bearing information. 


4. Unit speed circle 
Danskin defines the speed circle to be a circle with constant radius U. Inside 
this circle, a ‘cookie cutter’ dip of the helicopter at time t , will have a radius of ln 
our discussion, we will similarly use the concept of a unit speed circle which is defined 
to be a circle with constant unit radius. In our case, the relative size of a cookie cutter 


| : 4 К 
sonar dip at time t, will have a radius of Tr 


5. Position of datum 
The position of the datum is assumed to be accurately determined. This is definitely true 
when the flaming datum is still afloat but in the case that it is sunk, the last position is 


assumed to be accurately known by the helicopter. 


B. STRATEGIES USED IN SIMULATION MODEL 
1 Submarine Strategies 

The submarine has two conflicting goals. One goal is to move away from the 
datum as fast as possible and hence expand the FOC rapidly. This action forces the 
helicopter to search in a bigger and bigger area hence reducing its search effectiveness. 
The other goal is to avoid the helicopter as much as it can by moving directly away from 
its last position or using some other avoidance strategy. This is especially important if 
the helicopter’s last position (shown by its sonar dips) is near the submarine’s position 
since the helicopter favours picking successive dips nearer to each other as they 
consume less of its limited mission time. 

In the preliminary studies, several avoidance strategies were explored. One 
strategy Involves making the submarine move perpendicular to the direction from the 
helicopter’s last dip to its position at that time instant. The submarine which has the 
choice of two directions will pick the direction that will bring it further from the datum. 
Another strategy involves making the submarine move on a course that is almost 
perpendicular to the last two dips of the helicopter to ensure that it does not cut across 
the assumed path of the helicopter (using the direction of the last two dips as the 
helicopter course). Both of these strategies were found to be dominated by other 
strategies discussed and were thus discarded. In these cases, it seems that the submarine 
is making too many unnecessary changes of course and appears not to be moving much 
distance across the FOC. Another strategy has the submarine move directly towards the 
nelicopter’s last dip. This strategy was not used because it is difficult to establish the 
range to adopt this strategy. There 1s also a suspicion that this will onlv have a negligible 
effect on our results. 

After some exploration, the number of strategies were reduced to the following 


two classes of simple avoidance strategies: 


e Submarine moves directly away from the last dip. 
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• Submarine ignores the last dip and proceeds directly away from the flaming datuin. 
This strategy can be employed even if the search is passive. 


It is also uncertain whether the submarine should be on the edge of the FOC 
at time t,, since the helicopter may search at the edge. The Submarine can perhaps 
remain near the datum and start moving after the helicopter’s first dip. Hence, we will 
also include r, as another parameter for the submarine to choose in its strategy where 
r; is the radial distance of the submarine from the datum in the speed circle at time 7,. 


The submarine strategies are thus defined to be s = ( r;, avoidance strategy). 


2. Helicopter Strategy 

In building the sets of strategies to be emploved by the helicopter, an important 
principle is that the helicopter must not adopt any strategy which has a fixed pattern 
that can be exploited by the submarine. In Washburn’s Expanding Area Search 
Experiment [Ref. 10], game participants found out that using fixed search patterns like 
spiralling inwards or outwards from the datum are not good strategies since they can 
be exploited by the submarine. Random movements are thus used to ensure that the 
Submarine cannot exploit any of the helicopter’s strategy. 

Fron some of the analytical results discussed in related games, we saw that the 
helicopter should always attempt to distribute its search efforts as uniformly as possible 
over the entire FOC to be searched. This is done on the assumption that the submarine 
can be anywhere in the speed FOC. However this randomization of the positions Of the 
Фр 15 'expensive' for the helicopter. The helicopter has a limited mission time and two 
dips placed far apart wil’ consume much of this limited time . It will be more efficient for 
the helicopter to search within a localized area by carefully placing non-overlapping dips. 
This again may not be optimal since the submarine may be located at some distance 
awav from the helicopter localized search area and thus cannot be detected at all. The 
helicopter has to compromise between conducting randomized search and localized 
search. 

Another factor to consider is whether the helicopter should search on the edge 
of the FOC rather than the interior. If it is Known that the submarine is always moving 
away from the datum, clearly the optimal strategy for the helicopter is also to search on 
the edges. The amount of edge searches to be used will also be included in the strategy 


Ol the hehcopter. 


17 


To be precise, the helicopter at various times undertakes local searches that are 
either in the interior (inside) or on the edge of the FOC. The local searches are a 
succession of dips that are designed to be efficient at covering either its edge or its 
interior. To avoid the possibility of concentrating too much effort on a small part of the 
FOC , the helicopter occasionally abandons what he ts doing and starts again. These 
moments when a new local search 1s started are called ‘restarts’. The probability that a 
restart occurs after each dip is a constant (P(Restart)) that is part of the helicopter 
Strategies. After each restart , the helicopter chooses a new interior point with 
probability, P(interior), otherwise a new edge. point , and begins making another local 
search until another restart. The helicopter’s first local search is always of the interior 
tvpe , and since the location of the first dip 1s especially important , r, (the radial location 
of the first dip in the speed circle) is also included as part of the helicopter strategv. 
Although an early dip will correspond to having a smaller FOC, some advantage will 
also be lost since the position 1s also near the edge and some of the area covered by the 
sonar detection area will be wasted outside the FOC. Using the unit speed circle, 7, can 
vary from 0 to 1.0. In our simulation model, pure strategies A for the helicopter are thus 


defined in terms of various combination of r,, P( Restart) and P(interior) . 


h = (r,, P( Restart), P(interior)) 


A simple way of determining the relationship of times between successive dips 
of the helicopter is to use the concept of the unit speed circle. If the helicopter chooses 
a new point (x,v) in the unit speed circle from its previous position (x,y) at time t, let t' 


be the time that he arrives there. Travelling the physical distance from (х.у)01 10 


- "ERN 
е « . XV Ut ка X . и [ [ . ` 
(x',y')Ur' requires a time of (ey) 5 Den Therefore, t must satishi ment 
equation 
x,y)Ut — (x', y )UT 
pape UE шш y wey) = (Sal) 


V 


Equation (3.1) can be rearranged to obtain Equation (3.2), a quadratic equation in г. 


- 7 


Р U Be ин 
CTD ey) а (3.2) 
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Solving the equation (3.2), we have 


d — abc -- e 


; ا 
I — b°‏ 


И, where 


а= 52 ку -- 


522 DEC 
b= ./ x s y 


c = cosine [angle between (x,y) and (ху )] 


e L c abcd 


ER ги Яе 
Notice that тү 15 independent of t when D = 0 and the relationship between t and t is 


multiplicative. 


C. GAME THEORY 

To formulate our search problem as a two-person zero sum game, we define the pure 
strategies used by the helicopter to be A = (r,,P(Restart), P(interior)) and that used bv 
the submarine to be s = (13, avoidance type) The payoff in this game is the probability 
of the submarine being detected , P,(A,s) . The helicopter, being the maximizing plaver, 


will attempt to achieve 

max, min, P,(h,s) 

While the submarine, being the minimizing player, will attempt to do the opposite by 
achieving 


min, max, P,(h,s) 


The value of the game v, is thus given by 


nin, max, P (Bs < v « max,min, Pj(/,s) (252) 


D. MODIFIED RANDOM SEARCH EQUATION 
In his Expanding Area Search Experiment, Washburn considers the case of an 
evader who knows that he 1s spotted at time t and maneuvers away at speed U to evade 


detection. The searcher starts the search after a time delay , t, using speed V and sweep 

и 
. . . . . . . 2 . . 

the probability of detection obtained in his experimental results is closely approximated 


width w (Detection occurs when the target is within from searcher ). He shows that 


bv the equation 


Vw 


ЖС. eG) (3.4) 


— 
„ә 
Cn 

— 


The assumptions used to derive the equation are 
e Searcher searches randomly, which is a crucial assumption 
• Detections in non-overlapping time intervals are independent 


. . +. ЛЕ . .4. . 
area of farthest-on-circle at time « , and 1s therefore the detection probability during the 


The formula is derived bv reasoning that is the ratio of area searched in dt to 
infinitisimal interval dt . Summing over the entire search period we obtain the average 


number of detections in (z,, /) as 


t zu BEN 
д | аа for t2 1, (3.6) 


= 2 
le au 


From the assumptions above, the number of detections in (t,,t) is a Poission random 
variable and the probability of no detection iS therefore equal {о е" . The probability 
of detection is therefore 1 — e-"( as given in Equations (3.5). 


Our flaming datum problem is difTerent from Washburn's search experiment in that: 


1. The searcher does not have a continuous search capability. 


The target Knows the position of the searcher whenever he makes a sonar dip. 
We can derive a similar equation for our problem but modified to be 


r 
search тате 


Р, = | — EL FOC area et |927) 


effective dip area 


— (ume per look) | 
l— e - |. ` FOC aeag 4 (3.8) 


The "time per look" represents the average amount of time pA two uw 
represents the dipping time which is a constant in our game while k, T k, es. the 


dips of the helicopter. It can be reasoned to be equal to D + —— 


amount of 'flving around' the helicopter makes in covering the FOC. Since — is the 
ume taken to fly across half of the FOC, A, therefore measures the average amount of 
е ое ор те еппге РОС. The value of its upperbound is 2.0 which repesents the 
situation where the helicopter is always flying across and along the diameter of the FOC. 
k, 1s introduced because the helicopter must flv some fraction of its detection radius 
before making the next dip to avoid redundant coverage. The FOC area is given by 


пе слана (le expression reduces to 


Е; cm dip aree 
ج‎ uc I kE) 
a шшс = oe о 
MSc y. ru? (б О) 


We also introduce А; to account for inefTiciencies in covering the FOC area with circles, 
and k, because search will sometimes start after t,, the time the helicopter reaches the 


edge of the FOC. The final expression 15 thus given below: 


kyz R? 
(D-k È- aE) 
_ a 
Dee a (3.10) 


маске 
e U- submarine speed 


e V - helicopter speed 


е Р cookie cutter r o nus 
е D - time delay in dipping 
L 





өе т. = (ar) - time at which helicopter reaches edge of FOC. 
The quantitv 
k z R: 
— r a ІЗГІ) 
ШЕ; k (>) n Kx E) 
Is analogous to the search rate given by Vw in equations (3.4) to (3.6). 
n(t) in our modified equation is therefore given bv 
r kyn R? 
n(t) - | R Т Жа ш (39179 
VU SUV u CDI Ae c a) 
Performing the integration, we get 
АА 
= E = a. 
С) + Кир =) Mb. 
Ei (3.13) 
Г. 
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The value of our search game should be approximately P, if k, k,, A, and A, are chosen 


to make equation (3.10) fit the simulation data as closely as possible. 


tl 
ta 


IV. METHODOLOGY 


A. SIMULATION MODEL | 

Simulation models were used to determine the detection probability for each pair 
of helicopter-submarine strategies at each time t (r, < г < г“). Multiple programs 
were written since the submarine strategies cannot be easily generalised in a single 
program. Each program consisted of all the helicopter strategies and a single tvpe of 
Submarine strategy. The source codes are written in FORTRAN and implemented ın the 
ІВМ 3033. The flow charts for the programs are found in appendix A. A total of 5000 
runs are done for each program in order to obtain a precision of at least 10 % for small 


(0.04) probabilitv of detection estimates. The coeflicient of variation is given bv 


standard | deviation =: N H | pp 








mean A 7% я (4.1) 
P np 
Each run is considered a Binomial trial with outcome Л, = 1 or O and n runs are 


conducted to get the probability of detection estimate 


NE л 
T2902 (4.2) 


B. SOLVING THE GAME 

The detection probabilities (or payoffs) from the various outputs of the various 
simulation models are read into a payoff matrix using a simple FORTRAN program for 
each time r (1>t,) . These payoff matrices for each time t are then solved sequentially 
using a linear programming subroutine DDLPRS available in New IMSL Library. If 
x=(x,) and y (y) represents the probability distribution for the helicopter and 
submarine strategies respectively , and v is the value of the game, the linear program can 


be formulated as 


Minimize v subject to 
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> y Pons EE (4.3) 


2. y, = 1 (4.4) 


The primal of the LP solution gives the mixed strategies of the submarine while the dual 
solution gives the solution of the helicopter. Optimal strategies and the value of the 
game are obtained for given values of U,V, 7,, R and z. A Flow chart for the program 


is also given in Appendix B. 


C. MODEL FITTING 
Although. the Random Search Equation (3.10) has five parameters, there are 


actually three dimensions in that expression. This can be easily seen bv substituting 
° p. 

V 

Hence, only 2? = 8 combinations of dimensions are required to 





Сей ; 2 
Xpummy ^ 75-7 into Equation (3.10) where we obtain uheseimensigHS ире 5: 


R / 
+ and A 
check'if the sunulation data could be fitted by the Random Search Equation. The values 





of the various game matrices obtained at each time t, are then used to estimate the 
constants k,, A, and k, and A,. The curve fitting 1s done using a GRAFSTAT routine 
(non- linear regression curve fitting) available in NPS IBM 3033. Individual curves for 
each set of (z, , L, V. R, D) are fitted to get esuma Ok л. капу Елее щын 
are then combined to get one overall estimate for the unknown parameters. Statistical 


analvsis 1s then performed to check the goodness of the fit. 


D. COMPARISON WITH DYNAMIC SEARCH GAME MODEL 
The values of the probability of detection obtained is then compared with the results 
given by the Dynamic Search Game by Thomas and Washburn [Ref. 9]. The results of 


the Dynamic search game was computed using a Fortran program developed by 
Washburn. 
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V. RESULTS 


A. TABLES 
l. Strategies Used 
A total of 10 submarine and 27 helicopter strategies were explored in the final 


stages of our experimentation. Thev are listed in Tables 1 and 2 respectively. 


Table 1. SUBMARINE STRATEGIES USED 
n |_0 | Aoin 


10 
















Note 


e Avoid helicopter refers to the strategy of moving directly away from the 
helicopter’s last dip. 


e Avoid Datum refers to moving directly away from datum (centre of FOC) 
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Table 2. HELICOPTER STRATEGIES USED 


2. Parameters Used 
The various sets of parameters used are given in the Table 3. This 1s the 


minimum number of sets of parameters required to check if the simulation model could 
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be approximated bv the random search equation (3.10). Notice that normalized values 
are used where R and Y are both equated to 1.0. This is done in order to simplify the 


expression used in the non-linear package. 


Table 3. PARAMETERS USED / Сом 





3. Simulation Results 
For a given set of of V,U, x, ,D and R, simulation results were obtained for the 
above combinations of submarine-helicopter strategies shown above. A sample output 
of one such result 1s shown in Table 5 of Appendix C. The result shows the probability 
of detection for each time t where r,<ı<r*. А total of 270 data sets were generated for 


each set of parameter values. 


4. Game Results 
The value of the game together with the optimal strategies was then obtained 

Бу solving each 27 x 10 game matrix for each time t, (r,Et«t*). A sample output for a 
particular game is shown in Table 6 as Appendix D. The entire process was repeated 
seven more times to obtain results for eight different sets of (U,V, c, R,D) . A sample 
output is shown in Table 7 as Appendix E. 
5. Results of Curve fitting 

The values obtained from the eight sets of parameter values are then used to 


estimate one overall estimate of the unknown K, K; 4; and Kk, of Equation (3.10). The 


2] 


estimated k’s as well as a statistical summary of the fit 1s shown in Table 4 below. 


Table 4. STATISTICAL SUMMARY 


TABLE OF COEFFICIENTS 


628 OBSERVATIONS R-SQUARED 0.99281 STANDARD ERROR - 0.018864 
& COEFFICIENTS ADJ R-SQUARED 0.99278 26 ITERATIONS 


0.95 CONFIDENCE LIMITS 
COEFFICIENT ESTIMATE STD ERR T STAT SIG LEVEL LOWER UPPER 
K1 0.00021092 г. 9540Е-9 71889 0 0.00021091 0.00021093 
0.83762 1.1686E-5 71675 0 0.8376 0.83765 
1.0146 2-5/27Е-5 500.82 0 1.008 1.0212 
0.19498 2.5286E-6 77112 0 0.19498 0.19499 





B. GRAPHS 
1. Simulation data and Fitted Curves 
The values of the games for the eight sets of (U,V, t, R,D) are shown in Figure 
(5) and (6). The continous curves represent the curves fitted using non-linear regression 
while the symbols are actual data from the simulation results. Each curve represents a 


particular set of paramter values, and all the eight fitted curves use the same A, A>, A; and 
ks. 
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Figure 6. Probability of Detection Curves 
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2. Random search versus Dynamic Search Model 
In Figure (7) overleaf, the numbers represent the results from the Dynamic 
search model while the symbols shows the data from the simulation model. The fitted 
curves are also drawn in the figure. The parameters used are also shown in the legend 
just below all the curves. The four random search model curves were just reproduced 


from Figures (5) and (6) above. 
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Figure 7. Comparison of Results from Random Search and Dynamic Search Game 
Models 


VI. ANALYSIS OF RESULTS 
A. STRATEGIES 


1. Submarine 
The results for the optimal strategies of the submarine show that the submarine 
generally favours staying near the edge of the FOC whenever it utilizes the class of 
strategies of moving away from the helicopter's last dip. The other class of strategies of 
ignoring the helicopter and just moving away from the datum is not often used. If it is 
used, the results shows that the submarine favours staying near the datum and vill start 


moving away once the helicopter search begins. 


2. Helicopter 
Ihe results show that the helicopter optimal strategies are mainly to have a 
higher porportion of localized interior search. [t seems that too much ‘flying around’ is 
not optimal as onlv a limited number of dips can be conducted in the limited mission 
ume of the helicopter. Also, it seems that much effort should be placed on searching the 
interior of the FOC, though some search must still be allocated to searching the edges 


so as to deter the submarine from staving at the edge of the FOC. 


B. MODEL FITTING 

Ihe detection probability (or value of the game) was well estimated by the values 
obtained using the non-linear regression software in GRAFSTAT. The correlation 
coefficient is found to be close to I and there 15 no statistical evidence to indicate that 
these unknowns do not contribute to the equation at all. 

These estimated values also give us an idea on the wavy optimal searches are 
conducted. A, is approximately zero which shows that the helicopter need not flv a 
minimum fraction of its detection radius to its next dip. The value of k, is about .83. 
This is fairlv close to the mean distance of anv two points in a circle as given by Kendall 


in his book, “Geometric Probability’ [ Ref. 11]. The exact value of the mean was derived 
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to be sn 
uniformly over the FOC. k, is almost equal to I and this shows that the helicopter was 


)=.905R. This shows that the helicopter was picking points fairly 


fairly effectively in covering the FOC area with its cookie cutter circles. This could be 


because most of the dips occur in the interior of the FOC. ky, is approximately 0.2 which 


shows that most of the initial dips of the helicopter occurs near but not at the edge of 
fie FOG 


C. COMPARISON WITH RESULTS OF DYNAMIC SEARCH GAME 

The results given Бу the Dynamic search game gives a more pessimistic estimate of 
the probability of detection as compared to the simulation results. Generally, the results 
are about .07 to .15 lower. This shows that the ‘nimbless’ assumption used in the 
Dynamic search game outweighs the ‘motionless between dips’ assumption. There is 
also a greater difference when the value of D is zero. It is not clear which result 1s better 


since thev do not differ very much. 


D. WEAKNESS 

The general weakness of this method is in not being able to investigate enough of 
the strategies. There are infinitely manv strategies that can be used by the helicopter and 
submarine. However, manv of them will tend to be dominated bv certain classes of 
strategies. The assumptions used to derive the random search equation for the 
helicopter can again be criticized with the same argument as those used with anv random 
search model. An example ts the independent detections in non-overlapping intervals. 

The submarine motion is assumed constant except for instantaneous changes in 
course. This assumption is not important since the submarine is always moving slowly 
and its turning radius is small relative to the detection radius of the active sonar. In the 
simulation, the submarine is able to determine the bearing of the dips accuratelv. This 
1s obviouslv optimistic as to the direction finding capabilitv of the submarine. The 
model could later be modified to account for transmission losses or other factors that 
will not provide such an accurate bearing of the sonar dips. The cookie cutter model is 
also a basic model for anv detection system. Enhancement can perhaps be included but 
not much utility can be gained since the model itself is crude just like any other random 


search model. 
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VH. PRACTICAL USES/APPLICATION 


A. COMPARISON OF AIRCRAFT AND HELICOPTER PERFORMANCES 

The usefulness of such a technique is that it could be used together with other search 
games such as the Dvnamic Search Games by Thomas and Washburn or The Helicopter 
Search Game by Danskin to compare aircraft platforms that have different speeds, 
different distances to datum and detection performances. For example, helicopters are 
normally located near the impending threat and are normally close to the flaming datum 
(f any) while aircraft like the P-3 Orion (carrying sonobouys) are usually located much 


further away but have greater speed. The question 1s which platform performs better. 


VHI. CONCLUSION 


The results of this experiment is yet another approximated solution to the two 
dimensional flaming datum problem. The random search equation (3.10) developed 
using the unknowns derived from the simulation can be used to compute a rough 
estimate of the search capability of a helicopter starting its search or it can similarly be 
used by a submarine to assess its probability of being detected. The computation can 
be done easily and quickly and it can also give us an idea of the various interactions of 
the basic parameters of any scenario. The results given by the Dynamic search game 
also support the simulations results. The attitude to be taken is that this 1s a practical 
tool to use until something better comes along or when general analytical techniques 
become available. 

The exploration of various strategies used by both helicopter and submarine is also 
very useful as we discover that certain classes of strategies were always dominated by 
other classes. However, the optimal strategies obtained in the study cannot be taken as 
the ‘true’ optimal strategies to be used since there are infinitely many more to be 
explored. Rather, the results should provide us some idea of the distribution of search 
efforts (helicopter) or hiding efforts (submarine) especially when there are conflicting 


goals. 
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APP x 
ENDIX A. FLOW CHART OF SIMULATION PROGRAM 
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Figure 8. Flow chart for simulation program 
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APPENDIN B. FLOW CHART FOR SOLVING MATRIX GAME 


39 


Read In Data from 
various helicopter - submarine 


output data files into arrays 





Initialize Game Matrix 
for timet 


Call External Subroutine DDLRPS 
to solve LP 










Write Game 
Values 
Output 


Figure 9. Flow chart for solving matrix game using two person zero sum 


methodology 
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APPENDIX C. SAMPLE OUTPUT FROM A SIMULATION MODEL 


Iable 5. SAMPLE OUTPUT FROM A SIMULATION MODEL 
О. 000000000Е+00 
0. 000006000Е+00 
. 000000000Е+00 
"7 07D999791E=-02 
259299999 TE S(1 
о Е-01 
899339 7 38E-01 
2339964 2E>-01 
31129999995 
1015999996806 
159924367 
109999957 
169999957 
. 179999948 
2209999979 
2219999969 
2223399959 
. 230000000 
259922390 
125999995] 
2207909595 
22793990971 
2799 9971 
2259999962 
029999433 
03939943 
209993943 
200299943 
2219999995 
22919999993 
"5.999983 
232959998535 
59929974 
"3399999785 
2339999974 
252599999974 
2:99999974 
15399999974 
259909999974 
59099299975 
28259999978 
8599999974 
. 339999974 
22209099974 
2009999974 
„239999974 
5952990974 


со песо оо ооо ооо оо ооо ооо о ооо ооо ее © 
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5959999978 
7959999974 
. 339999974 
. 339999202 
19999999 78 
32939939972 
339999974 
. 339999974 
222993997 
. 399999972 
-339999974 
-339999974 
. 339999974 
-399999974 
- 339999974 
393939974 
299990971 
32208069875 
239999074 
1339999974 
520989975 
339999974 
339999972 
2 239999974 
2959999974 
. 359999974 
. 339999974 
2329309314 
339999974 


СО СОКСО СО 959050 090 ооо ооо оо со 


РКТ 0. 750000000 PAREA 0. 750000000 R 1. 00000000 


1. 00000000 0.100000024 20. 0000000 0. 000000000E+00 
100. 000000 
1. 00000000 27.500.000) 0.250000000 0. 000000000Е+00 
2098292595 


Note: The output above are the detection probabilities obtained for each time t 
(25<7<100) when the helicopter utilizes strategy x against the submarine strategy ys The 
time of the first dip was computed to be 26.829. This is because the initial dip was inside 
the OC. 
The parameters used in this model are given below: 
e V=1,0U=.1, D=0,7* = 100, L=27.5, R=1.0,7,,=0.25,,=1.0, 
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APPENDIX D. SAMPLE OUTPUT AFTER SOLVING А САМЕ 


Table 6. SAMPLE OUTPUT OF VALUE AND OPTIMAL STRATEGIES OF 
GAME WITH TIME 


TIME 50 

OBJECTIVE = 05218 

PRIMAL 

ШІ Ши Үз Yá Y5 Y6 Y7 Y8 Y9 Y10 


0.0000 0.0994 0.0000 0.7453 0.1553 0.0000 0.0000 0.0000 0.0000 0.0000 


X1 X2 X3 X4 ДЕ X6 X7 X8 x9 
0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 


X10 X11 X12 KS X14 X15 X16 X17 X18 
0.0000 0.0000 0.2112 0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 


X19 X20 21 X22 X23 X24 X25 X26 X27 
0200002020000 1025975 9200007970000 0239932970000 0. 00000. 0000 


Note: The output is for the case when time of detection 1s 50 time units. The parameters 


used in this model is given below: 


е |. 

e D=0 

e ү” = 100 
° К = 1.0 


"LE 2 Ое т,= 25 
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APPENDIX E. SAMPLE OUTPUT OF GAME VALUES VERSUS TIME 


Table 7. SAMPLE OUTPUT OF GAME VALUES OBTAINED 


Time of Value Time of Value Time of Value 
Detection (Prob. of Detection (Prob. of Detection (Prob. of 
Detection) Detection) Detection) 


— 29 | ow | ss [maa sss о 
| 
в [ом | [ом | s | ооз 
x 
[3s osm? | я [ ов | м | om 
04787 
0.4803 
0.0103 
0.6104 
31 | osn 717974777997 06008” 
в | 0з [ м [| ом | 10 | osos 
о оо | С | — 
[39 | OE | | —— TL — 


3 | tC 
AIAIGA 
Сл UL) 


( 


с‏ ]2 | ریا 521 | ریا ا ری 
دیا .4 РОМ 1 Сл‏ = 
Сл‏ 


„ә 


Note: 


Gs 


Сл 
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